APPARATUS, METHOD, AND COMPUTER PROGRAM PRODUCT FOR IMAGE 
PROCESSING 

This application is based on Japanese Patent 
Application No, 11-118578 filed on April 26, 1999, the 
contents of which are hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the compression and 
expansion process of an image data using the discrete cosine 
transform technique, in particular, relative to the 
reduction of the mosquito noise. 

2. Description of Related Art 

The JPEG (Joint Photographic Experts Group) method 
based on the discrete cosine transform is widely used as a 
means of compressing and expanding the image data. Image 
processing devices such as copying machines, scanners and 
printers apply the compression and expansion process to the 
image data in order to reduce the capacity requirement of 
the memory used for storing the image data. However, the 
compression and expansion process using the discrete cosine 
transform tends to generate mosquito noises which 
deteriorate the image quality in the vicinity of edges where 



the density values of pixels change sharply. 

Publication of Unexamined Japanese Patent Application 
JP-A-5-2 94 0 1 8 discloses a technique of removing mosquito 
noises. The technique removes the noises by, after 
5 compressing an image data, correcting an image data in an 
edge region during the expansion of the compressed image 
data . 

The technology disclosed in the above publication is 
a technology of allowing the generation of the mosquito 
10 noises during the compression of the image data containing 
the edge region using the JPEG method, and removing the noises 
by another process later. 

I * owovor / — ±€ — the Moyquilu noises — ar e too — large^JLho - 
process of correcting the image datajjrtfie edge region by 
15 treating the image data witt the density value below a 
specified value a^tioises may inadvertently delete a part 
^ of the oriq^flalimage together with the mosquito noises. 
Therefpre, it is necessary to reduce the generation of tt 
mosquito noises themselves in order to removing the mosquito 
20 poises without losing the part of tlie'^rrr^ ginal i mage. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to reduce the 
generation of the mosquito noises in an apparatus, a method, 
and a computer program product for image processing using 
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the image compression based on the discrete cosine transform. 
This object is achieved by providing the following apparatus, 
method , and computer program product. 

The apparatus for image processing including a region 
detector for detecting an edge region in an image data, a 
density conversion unit for reducing a density difference 
within the edge region detected by the region detector, a 
compression unit for compressing the image data within the 
edge region where the density difference is reduced by the 
density conversion unit, using discrete cosine transform, 
and an expansion unit for expanding the image data compressed 
by the compression unit. 

The method for image processing including the steps of 
detecting an edge region within an image data, reducing a 
density difference within the edge region, compressing the 
image data within the edge region where the density 
difference is reduced, using discrete cosine transform, and 
expanding the compressed image data. 

The computer program product for image processing 
including the steps of detecting an edge region within an 
image data, reducing a density difference within the edge 
region, compressing the image data within the edge region 
where the density difference is reduced, using the discrete 
cosine transform, and expanding the compressed image data. 



The objects, characteristics, and advantages of this 
invention other than those set forth above will become 
apparent from the following detailed description of the 
preferred embodiments, which refers to the annexed drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a digital copying machine 
according to an embodiment of the present invention; 

Fig. 2 is a diagram of assistance in explaining the 
detection of edge regions by means of a region detector of 
an image processing unit of the digital copying machine; 

Fig. 3A and Fig. 3B show examples of input image data 
for a density conversion unit of the image processing unit; 

Fig. 4A and Fig. 4B show output image data of the density 
conversion unit that correspond to the image data shown in 
Fig. 3A and Fig. 3B; 

Fig. 5A and Fig. 5B show input image data for a density 
restoring unit of the image processing unit that correspond 
to the image data shown in Fig. 4A and Fig. 4B; 

Fig. 6A and Fig. 6B show output image data of the density 
restoring unit that correspond to the image data shown in 
Fig. 5A and Fig. 5B; 

Fig. 7 is an example of an input image data for the image 
processing unit; 

Fig. 8A and Fig. 8B show output image data of a 



conventional digital copying machine and the digital copying 
machine according to the present invention that correspond 
to the image data shown in Fig. 7; 

Fig. 9A and Fig. 9B show an operation flow chart of the 
image processing unit; and 

Fig. 10 is a perspective view of the image processing 
system of another embodiment of the present invention. 
DETAILED DESCRIPTION OF THE EMBODIMENTS 

The embodiments of this invention will be described 
below with reference to the accompanying drawings . 

An image processing unit 10 shown in Fig. 1 as an 
embodiment of this invention is incorporated in a digital 
copying machine. The digital copying machine has an image 
reader 3 0 and a printing unit 40. The image reader 30 reads 
the document image to generate RGB eight-bit image data. The 
image processing unit 10 applies various processes to the 
image data to generate CMYK eight-bit image data. The 
printing unit 4 0 prints the output data on papers. The 
symbols R, G, B, C, M, Y and K stand for red, green, blue, 
cyan, magenta, yellow and black, respectively. Eight-bit 
image data is data that contains each color component's 
density value expressed by an eight-bit signal per pixel. 
The image processing unit 10 consists of a CMYK conversion 
unit 11, a correction processing unit 12, a density 



conversion unit 13, a compression unit 14, an expansion unit 
16 , a density restoring unit 17, a region detector 18, and 
memories 15, 19, Since the basic control circuit and the 
mechanical constitution of the digital copying machine are 
5 identical those of the conventional machine, their 
descriptions are not repeated here. 

Now, the outline of the operation of the image 
processing unit 10 is described along the flow of the image 
% data. 

yjl 10 First of all, the RGB eight-bit image data from the image 

\i 

j^i reader 3 0 is inputted into the CMYK conversion unit 11 and 

i p 

kh the region detector 18. 

O The CMYK conversion unit 11 applies the UCR (under color 

[p removal) process, the color system conversion process , etc., 

W 15 to the RGB eight-bit image data to generate CMYK eight-bit 

image data. The CMYK eight-bit image data is inputted into 
the correction processing unit 12 . Since the CMYK conversion 
unit 11 is similar to the conventional unit, detail 
descriptions are not repeated here. 

20 

The region detector 18 divides the RGB eight-bit image 
data into a plurality of areas and detects which of the two 
regions, an edge region and a non-edge region, each area 
belongs to. The edge region is where many edges of characters 
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and fine lines exist. The non-edge region is an area other 
than the edge region and contains a halftone dot region where 
halftone dots exist. The detection result is inputted into 
the correction processing unit 12 and the density conversion 
5 unit 13 and is stored into the memory 19. 

The correction processing unit 12 applies the edge 
enhancement correction to the image data of the edge region 
based on the detection result of the region detector 18, and 
Cy applies the smoothing correction to the image data of the 

HI 10 halftone dot region. The corrected image data is inputted 

m 

Jf into the density conversion unit 13. 

The density conversion unit 13 executes to the image 
p«. data of the edge region the density conversion process that 

lij converts the eight-bit image data into seven-bit image data 

£J! 15 based on the detection result of the region detector 18. 

Seven-bit image data is image data expressed in seven-bit 
signals per each pixel. Seven-bit image data of the edge 
region and eight-bit image data of the non-edge region are 
inputted into the compression unit 14. The compression unit 
2 0 14 compresses the image data, based on the JPEG method using 
the discrete cosign transform. The compressed image data is 
stored into the memory 15. 

The expansion unit 16 reads the image data from the 
memory 15 when the image data is to be used, and applies the 
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expansion process to the image data. 

The density restoring unit 17 executes the density 
restoring process that converts seven-bit image data of the 
edge region into the eight-bit image data based on the 
detection result of the region detector 18 stored in the 
memory 15 and outputs the converted data of edge region to 
the printing unit 4 0 together with the eight-bit image data 
of non-edge region. The CYMK eight-bit image data is printed 
on a paper using the printing unit 40. 



10 



kh Now, the process of the region detector 18 is described 

H> in detail . 

CI The vicinities of the edges of characters and fine lines 

!|j contained in an edge region have large density differences. 

^ £ 

J*:. 15 Therefore, the compression and expansion process using the 

discrete cosine transform may generate a large amount of 
mosquito noises. In the present embodiment, the eight-bit 
image data of the edge region detected by the region detector 
18 is converted into the seven-bit image data prior to the 
20 compression process in order to reduce the density 
differences . 

The detection of the edge region by the region detector 
18 is executed for the entire input image data. More 
specifically, the image data is first divided into a 
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plurality of areas consisting of N pixels X n pixels . In case 
of Fig. 2 , the eight areas A through H consist of eight pixels 
X eight pixels. An edge element is shown in black and the 
threshold value of the edge region is "5." In other words, 
5 an area with more than five edge elements is determined to 
belong to the edge region and the area containing five or 
less edge elements is determined to belong to the non-edge 
region. 

For example, the area A includes eight edge elements, 
10 so that a signal "1" is outputted as the attribute data, while 
the area C includes three edge elements so that a signal "0" 
N- is outputted as the attribute data. The signals "1" and the 

Cl "0" indicate that the areas belong to the edge region and 

3*. 

F| the non-edge region respectively. The detection result of 

3{ 15 1 bit which consists of either "1" or "0" is inputted into 

the correction processing unit 12 and the density conversion 
unit 13, and is stored into the memory 19. The entire areas 
A through H are detected whether each area belongs to either 
the edge region or the non-edge region. As a result, the 
20 attribute data for the target areas A through H becomes 
"11001110," or "OxCE" in the hexadecimal notation. 

Next, the process of the density conversion unit 13 will 
be described below. 
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Fig. 3A and Fig. 3B show an image data of an edge region 
and an image data of a non-edge region respectively. The 
image data are the input image data for the density conversion 
unit 13 . Incidentally , the density conversion process is not 
5 applied to the non-edge region. 

The image data of the edge region consists of eight 
pixels X eight pixels. Also, the density of the image data 
is expressed in eight-bit data, and is classified into 256 
steps ranging from 0x00 to OxFF. The density of the first 
10 part 20, the second part 21 and the third part 22 shown in 



Fig. 3A are "OxAO," "0x3 0" and "0x0 0" respectively. 

The density difference between the first part 2 0 and 
the second part 21 is "0x70" ( =0xA0 — 0x30 ) , and the density 
difference between the first part 2 0 and the third part 22 
15 is "OxAO" ( =0xA0-0x00 ) . 

Fig. 4A and Fig. 4B show the output image data of the 
density conversion unit 13. 

The density conversion unit 13 converts the eight-bit 
image data of the edge region into the seven-bit image data 
20 based on the detection result of the region detector 18 . More 
specifically, the density conversion unit 13 executes a 
process of reducing the imaged data into one half by dividing 
the image data by 2 . In other words, the density conversion 
unit 13 reduces the density difference to one half by 
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converting the N-bit image data into (N-l)-bit image data 
by means of a bit calculation suitable for computer 
processing . 

The density value "OxAO" of the first part 20 is 
converted into "0x50" ( ^OxAO/2) . The density value "0x3 0" 
of the second part 21 is converted into "0x18" (=0x30/2). 
The density value "0x00" of the third part 22 is converted 
into "0x00" (=0x00/2) • The density difference between the 
first part 20 and the second part 21 becomes "0x38" (=0x50 
— 0x18) . The density difference is equal to one half of the 
density difference "0x7 0" before the density conversion 
process. The density difference between the first part 20 
and the third part 22 is "0x50" (=0x50 — 0x00) and is one half 
of the density difference "OxAO" before the density 
conversion process. Thus, the density difference within the 
edge region is reduced. 

The density of the image data is generally lighter due 
to the density conversion process. However, it is difficult 
to separate image data with light density from noises. The 
density conversion unit 13 is further treated with a raising 
process where a certain value is to be added to the image 
data after the density conversion process to make the density 
of the image data darker . In other words , the dens ity 
conversion unit 13 makes the density of the (N-l)-bit image 



data dark by a certain amount to facilitate the separation 
of the image data from noises. 

For example, using the top bit, "0x8 0" is added to the 
density values of the first part 20, the second part 21 and 
the third part 22. Therefore, the density value of the first 
part 20 is converted to "OxDO" (=0x50 + 0x80), the density 
value of the second part 21 is converted to "0x98" (=0x18 
+ 0x80), and the density value of the third part 22 is 
converted to "0x80" (=0x00+0x80). Fig. 4A shows the image 
data subjected to the conversion process. 

The image data of the edge region with the reduced 
density difference and the image data of the non-edge region 
are compressed and stored into the memory 15. 

Next, the process content of the density restoring unit 
17 will be described below. 

Fig. 5A and Fig. 5B are the image data where the 
compression process is applied and correspond to Fig. 4A and 
Fig. 4B. The image data are the input image data for the 
density restoring unit 17. Incidentally, the density 
restoring process is not applied to the non-edge region. 

The density difference within the edge region becomes 
small since the image data of the edge region is converted 
into seven-bit image data before compression. The mosquito 
noise generation can be alleviated. However, mosquito 



noises can slightly occur in the area where the density is 
light, such as the third part 22. The third part 22 shown 
in Fig. 5A contains the elements 22a, 22b having a density 
value different from that of the original value "0x80" before 
5 the compression process is applied. The density of the 
elements 22a is lighter than the original density, e.g., 
"0x7F." The density of the elements 22b is darker than the 
original density, e.g., "0x81." 

Therefore, the density restoring unit 17 executes a 
10 process of removing mosquito noises existing in the areas 
where the density is light. More specifically, a density 
value below a specified threshold value, e.g., "0x88," is 
considered to be "0x8 0," and converted to "0x0 0." The 
density value "0x80" corresponds to "0x00" before the density 

a §S 

£9 15 conversion process. 

In addition, the density restoring unit 17 returns the 
image data with density values higher than the specified 
threshold value to eight-bit image data. Specifically, the 
values obtained by subtracting a certain value, e.g., "0x7F," 
2 0 from the density values of the image data are multiplied by 
2. The density restoring process is equivalent to the 
reverse operation of the density conversion process. Fig. 
6A and Fig. 6B are the output image data of the density 
restoring unit 17. 



; st? 
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The density of the non-edge region do not change despite 
the density conversion unit 13 and the density restoring unit 
17 as can be seen from Fig. 3B, Fig. 4B, Fig. 5B and Fig. 
6B. 

Fig, 8A shows the output image 24 of the conventional 
image processing apparatus based on the input image 23 shown 
in Fig. 7. The output image 24 contains the mosquito noises 
26. Fig. 8B show the output image 25 of the image processing 
unit 10 of the digital copying machine according to the 
present embodiment based on the same image 23. The output 
image 25 contains no mosquito noise. In other words, 
although the mosquito noises 2 6 appear around the edges of 
characters and fine lines in the prior art, no mosquito noise 
occur in the present embodiment. 

Next, the operation of the image processing unit 10 will 
be described referencing the flow chart of Fig. 9A and Fig. 
9B. 

The RGB eight-bit image data from the image reader 3 0 
is converted into CMYK eight-bit image data at the CMYK 
conversion unit 11 (step SI). 

At the region detector 18 the HVC conversion of the CMYK 
eight-bit image data is first executed to generate the 
lightness data ( step S2 ) . Next, isolated points are detected 



based on the lightness data, and the number of isolated points 
is counted in a target area surrounding the target pixel (step 
S3) • Next, it is determined whether the number of isolated 
points is larger than a threshold value T A (step S4 ) . 

If the number of isolated points is determined to be 
larger than the threshold value T A , the target area belongs 
to the halftone dot region, so that the smoothing process 
is applied (step S5), and the process advances to the step 
S8 . 

On the other hand, if the number of isolated points is 
equal to or smaller than the threshold value T A , the number 
of edge elements is counted (step S6). More specifically, 
the derivative filter process is applied to the lightness 
data. If the output of the derivative filter process is 
greater than a specified value, the target pixel is 
determined to be an edge element. The number of pixels which 
are edge elements are counted within the target area of N 
pixels Xn pixels surrounding the target pixel. 

Next, it is judged whether the number of edge elements 
is larger than a threshold value T B (step S7 ) . 

If the edge element count is judged to be equal to or 
smaller than the threshold value T B , the process advances 
to the step S 8. 

At the step 8, a signal "0" is inputted into the memory 



19 as the attribute data since the target area belongs to 
the non-edge region. Next, the process advances to the step 
S13 of Fig, 9B. 

If the edge element count is judged to be larger than 
5 the threshold value T B , the target area belongs to the edge 
region, so that the signal "1" is inputted into the memory 
19 as the attribute data (step S9). 

Next, the correction processing unit 12 applies the edge 
frj enhancement process to the edge region (step S10). 



U1 10 At the density conversion unit 13 an appropriate process 

US 

is applied to the target area based on the attribute data 

3 

f ! ; stored in the memory 19 (step Sll) . More specifically, when 

the attribute data stored in the memory 19 is "1," the target 
S area is judged to belong to the edge region, so that the 

\M 

f£* 15 density conversion process is applied to the image data 

within the target area to reduce the density difference. On 
the other hand, if the attribute data is "0," the target area 
is determined to the non-edge region, so that the density 
conversion process is not applied to the image data within 
20 the target area. 

Next, the raising process is applied to the image data 
after the density conversion process adding a certain value 
using the top bit to make the density of the image data dark 
(step SI 2) . This is to make it easier to separate the image 
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data from noises. The process advances to the step S 13 of 
Fig. 9B. 

At step S13 the image data of the target area is 
compressed. Next, the compressed image data is stored into 
the memory 15 (step S14). The expansion unit 16 reads the 
image data from the memory 15 when the image data is to be 
actually used, and the expansion process is applied to the 
image data (step S15). 

Next, it is determined whether the attribute data stored 
in the memory 19 is "1" or not (step S16) . If the attribute 
data is judged to be "0, " the target area is a non-edge region, 
and the process terminates as the density conversion process 
is not going to be applied. 

If the attribute data is judged to be "1," it is further 
judge whether the density values of the pixels of the target 
area are smaller than a threshold value T c or not (step S17 ) . 
If the density value of the target pixel is judged equal to 
or larger than the threshold value T c , the process advances 
to the step S19. 

If the density value of the target pixel is judged to 
be smaller than the threshold value T c , the density value 
of the target pixel is converted to "0x00" (step S18) . Thus, 
mosquito noises of a light degree in the area with light 
density are removed. Next, the process advances to the step 



At step SI 9, a certain value, e.g., "0x7F," is 
subtracted from the density values larger than the threshold 
value T c . Next, the density restoring process is applied to 
the image data (step S20) . Specifically, by multiplying the 
values thus obtained by 2 , the image data of the target area 
that belongs to the edge region is returned to eight-bit image 
data . 

As can be seen from the above, the compression process 
is applied to the image data having reduced density 
differences within the edge region. Thus, it is possible to 
alleviate the generation of mosquito noises and to prevent 
some portions of the necessary image from being removed. 

It is obvious that this invention is not limited to the 
particular embodiments shown and described above but may be 
variously changed and modified without departing from the 
technical concept of this invention. 

Although eight-bit image data is suggested to be the 
subject in this embodiment, the technique can be applied to 
N-bit image data. In such a case, the density difference 
within an edge region can be reduced by converting N-bit image 
data to (N-l)-bit image data. Moreover, the process of 



converting N-bit image data to (N-i)-bit image data can be 
used as a process of reducing the density difference within 
an edge region. However , the number i must be a number 
smaller than the number N. 

5 

It is also possible to reduce the density difference 
within an edge region by means of subtracting a certain value 
from a density value larger than a threshold value T D . Also, 
it is possible to reduce the density difference within an 

10 edge region by means of adding a certain value to a density 
value smaller than a threshold value T E . Moreover, it is also 
possible to reduce the density difference within an edge 
region by means of subtracting a certain value from a density 
value larger than the threshold value T D/ and simultaneously 

15 adding a certain value to a density value smaller than the 
threshold value T E . 

Furthermore, although an image processing unit 
incorporated in a digital copying machine is described in 
the above as an example of the embodiment, the present 

2 0 invention can be applied an image processing unit 
incorporated in an image reading apparatus such as a scanner 
that reads documents or an image forming apparatus such as 
a printer that prints image data on papers . 

It is also applicable to computers such as a personal 
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computer by providing a computer program product having a 
program corresponding to the operational procedures of the 
image processing unit. The computer program product 
includes a storage medium where the program is stored. A 
specific example is an image processing system 50 shown in 
Fig. 10. The image processing system 50 consists of an image 
reading apparatus 52 , an image forming apparatus 53 and a 
computer 51. The computer 51 functions as an image 
processing unit based on a program provided by a floppy disk 
54 , which is the computer program product . Accordingly, the 
computer 51 applies a certain image processing to an image 
data from the image reading apparatus 52 and outputs the data 
thus obtained to the image forming apparatus 53. 



